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CLAIMS 

What is claimed is: 

1. A method of analyzing video frames capturing a 3D scene over time to automatically 
generate a road map of the 3D scene comprising: 

5 detecting positions of objects in the video frames; 

estimating 3D transformation parameters for the objects; 

predicting heights of the objects based at least in part on the 3D transformation 
parameters; and 

estimating road boundaries of the 3D scene using the object positions to generate the 
10 road map. 

2. The method of claim 1, further comprising estimating a height map for objects 
moving on a road of the road map. 

3. The method of claim 1, further comprising removing outliers from the predicted 
heights of objects and repeating estimation of the 3D transformation parameters and prediction 

1 5 of the heights of objects. 

4. The method of claim 1, wherein detecting positions of objects comprises applying a 
foreground object detection process to the video frames. 

5. The method of claim 1, further comprising removing outlier pixels from the road 

map. 

20 6. The method of claim 1, wherein estimating road boundaries comprises applying a 

region growing process to object positions to find pixels of the video frames belonging to a road 
surface in the 3D scene. 

7. An article comprising: a machine accessible medium containing instructions, which 
when executed, result in analyzing video frames capturing a 3D scene over time to 

25 automatically generate a road map of the 3D scene by 

detecting positions of objects in the video frames; 
estimating 3D transformation parameters for the objects; 

predicting heights of the objects based at least in part on the 3D transformation 
parameters; and 

30 estimating road boundaries of the 3D scene using the object positions to generate the 

road map. 

8. The article of claim 7, further comprising instructions for estimating a height map for 
objects moving on a road of the road map. 

9. The article of claim 7, further comprising instructions for removing outliers from the 
35 predicted heights of objects and repeating estimation of the 3D transformation parameters and 



10 

prediction of the heights of objects. 

10. The article of claim 7, wherein instructions for detecting positions of objects 
comprises instructions for applying a foreground object detection process to the video frames. 

1 1. The article of claim 7, further comprising instructions for removing outlier pixels 
5 from the road map. 

12. The article of claim 7, wherein instructions for estimating road boundaries 
comprises instructions for applying a region growing process to object positions to find pixels 
of the video frames belonging to a road surface in the 3D scene. 

13. A system comprising: 

10 a foreground object detection unit to analyze video frames of a 3D scene and detect 

objects and object positions in the video frames; 

an object scale prediction unit to estimate 3D transformation parameters for the objects 
and to predict heights of the objects based at least in part on the 3D transformation parameters; 
and 

1 5 a road map detection unit to generate the road map by estimating road boundaries of the 

3D scene using the object positions. 

14. The system of claim 13, wherein the system estimates a height map for objects 
moving on a road of the road map. 

15. The system of claim 13, wherein the object scale prediction unit is configured to 
20 remove outliers from the predicted heights of objects and repeat estimation of the 3D 

transformation parameters and prediction of the heights of objects. 

16. The system of claim 13, wherein the road map detection unit is configured to 
remove outlier pixels from the road map. 

17. The system of claim 13, wherein the road map estimation unit estimates road 

25 boundaries by applying a region growing process to object positions to find pixels of the video 
frames belonging to a road surface in the 3D scene. 



